Electronic apparatus, display apparatus and method of controlling the same

ABSTRACT

Disclosed are an electronic apparatus, a display apparatus and a method of controlling the same an electronic apparatus, a display apparatus and a method of controlling the same, the electronic apparatus including: a speaker configured to output a sound; a microphone configured to receive a user voice; a communicator configured to perform communication; a processor configured to: identify a state of an external apparatus through the communicator based on reception of the user voice, process the received user voice and output a sound corresponding to a process result through the speaker based on identification that the external apparatus is in a turned-off state, and control the communicator to transmit information about the received user voice to the external apparatus and request the external apparatus to process the voice based on identification that the external apparatus is in a turned-on state.

CROSS-REFERENCE TO RELATED THE APPLICATION

This application is a Continuation application of U.S. patentapplication Ser. No. 16/997,443, filed on Aug. 19, 2020, which is basedon and claims priority under 35 U.S.C. § 119 to Korean PatentApplication No. 10-2019-0105614 filed on Aug. 28, 2019 in the KoreanIntellectual Property Office, the disclosures of both of which areincorporated by reference herein in their entirety.

BACKGROUND Field

The disclosure relates to an electronic apparatus, a display apparatusand a method of controlling the same, and more particularly to anelectronic apparatus, a display apparatus, and a method of controllingthe same, in which a voice uttered by a user is processed.

Description of the Related Art

An artificial intelligence (AI) speaker may perform functions forlistening to music, searching information, etc. by recognizing a uservoice.

Recently, the AI speaker has been widely and increasingly used becausethe AP speaker can be used in controlling household devices by a voicebased on voice recognition and thus facilitate creation of a smart homeenvironment.

The AI speaker may be inconvenient for a user who is not used to usingelectronic devices because various functions such as communicationconnection are typically set through linking with a smartphone and sucha setting process is complicated.

Further, provision of service using the AI speaker is carried out by arestricted method based on a voice output, and therefore there may belimits to the extension of the functions.

SUMMARY

According to an embodiment of the disclosure, an electronic apparatusincludes: a speaker configured to output a sound; a microphoneconfigured to receive a user voice; a communicator configured to performcommunication; a processor configured to: identify a state of anexternal apparatus through the communicator based on reception of theuser voice, process the received user voice and output a soundcorresponding to a process result through the speaker based onidentification that the external apparatus is in a turned-off state, andcontrol the communicator to transmit information about the received uservoice to the external apparatus and request the external apparatus toprocess the voice based on identification that the external apparatus isin a turned-on state.

The processor may control the speaker output a sound for guiding a userto turn on the external apparatus based on the identification that theexternal apparatus is in the turned-off state.

The processor may control the communicator to transmit a request signalfor turning on the external apparatus to the external apparatus based onthe identification that the external apparatus is in the turned-offstate.

The processor may be configured to: identify whether an error occurs inprocessing the voice, and control the speaker to output a sound forguiding a user to turn on the external apparatus based on identificationthat the error occurs.

The processor may be configured to: identify whether an error occurs inprocessing the voice, and may control the communicator to transmitinformation about the error to the external apparatus based onidentification that the error occurs.

The processor may be configured to: identify a service type related tothe user voice, and identify whether to request the external apparatusto process the voice based on the identified service type.

The processor may be configured to control the communicator to transmitinformation about the received user voice to the external apparatus andrequest the external apparatus to process the voice based onidentification that the service type is related to visual content.

According to an embodiment of the disclosure, a display apparatusincludes: a display configured to display an image; a communicatorconfigured to perform communication; a processor configured to: identifywhether an external apparatus is connected through the communicatorbased on identification of a change from a turned-off state to aturned-on state, receive information about a user voice from theexternal apparatus through the communicator based on identification thatthe external apparatus is connected, process the user voice and controlthe display to display an image based on a process result.

The display apparatus may further include a user input receiverconfigured to receive a user input, and the processor may be configuredto identify the change from the turned-off state to the turned-on statebased on the received user input.

The processor may be configured to identify the change from theturned-off state to the turned-on state, based on identification that arequest signal for turning on the display apparatus is received from theexternal apparatus through the communicator.

The processor may be configured to control the display to display a userinterface (UI) about an error in processing the voice based onidentification that information about the error is received from theexternal apparatus through the communicator.

The processor may be may be configured to identify whether informationabout the error is received, based on the identification of the changefrom the turned-off state to the turned-on state.

According to an embodiment of the disclosure, a method of controlling anelectronic apparatus, includes: identifying a state of an externalapparatus based on a user voice received through a microphone;processing the received user voice and outputting a sound correspondingto a process result through a speaker based on identification that theexternal apparatus is in a turned-off state; and transmittinginformation about the received user voice to the external apparatus andrequesting the external apparatus to process the voice based onidentification that the external apparatus is in a turned-on state.

The method may further include outputting a sound for guiding a user toturn on the external apparatus through the speaker based on theidentification that the external apparatus is in the turned-off state.

The method may further include transmitting a request signal for turningon the external apparatus to the external apparatus based on theidentification that the external apparatus is in the turned-off state.

The method may further include: identifying whether an error occurs inprocessing the voice; and outputting a sound for guiding a user to turnon the external apparatus through the speaker based on identificationthat the error occurs.

The method may further include: identifying whether an error occurs inprocessing the voice; and transmitting information about the error tothe external apparatus based on identification that the error occurs.

The method may further include: identifying a service type related tothe user voice; and identifying whether to request the externalapparatus to process the voice based on the identified service type.

According to an embodiment of the disclosure, a method of controlling adisplay apparatus, includes: identifying whether an external apparatusis connected for communication based on identification of a change froma turned-off state to a turned-on state, receiving information about auser voice from the external apparatus based on identification that theexternal apparatus is connected, processing the user voice anddisplaying an image based on a process result.

The method may further include displaying a user interface (UI) about anerror in processing the voice based on identification that informationabout the error is received from the external apparatus.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and/or the aspects will become apparent and more readilyappreciated from the following description of exemplary embodiments,taken in conjunction with the accompanying drawings, in which:

FIG. 1 illustrates an electronic apparatus and a display apparatusaccording to an embodiment of the disclosure;

FIG. 2 illustrates an electronic apparatus and a display apparatusaccording to another embodiment of the disclosure;

FIG. 3 is a block diagram of an electronic apparatus according to anembodiment of the disclosure;

FIG. 4 is a block diagram of a display apparatus according to anembodiment of the disclosure;

FIG. 5 conceptually illustrates an example of operation between anelectronic apparatus and a display apparatus according to a firstembodiment of the disclosure;

FIG. 6 conceptually illustrates another example of operation between anelectronic apparatus and a display apparatus according to a firstembodiment of the disclosure;

FIG. 7 is a flowchart showing a method of controlling the electronicapparatus according to the first embodiment of the disclosure;

FIG. 8 illustrates an example that the electronic apparatus according tothe first embodiment of the disclosure processes a user voice;

FIG. 9 illustrates an example that the display apparatus according tothe first embodiment of the disclosure processes a user voice;

FIG. 10 conceptually illustrates operation between an electronicapparatus and a display apparatus according to a second embodiment ofthe disclosure;

FIG. 11 is a flowchart showing a method of controlling the electronicapparatus according to the second embodiment of the disclosure;

FIG. 12 conceptually illustrates operation between an electronicapparatus and a display apparatus according to a third embodiment of thedisclosure;

FIG. 13 is a flowchart showing a method of controlling the electronicapparatus according to the third embodiment of the disclosure;

FIG. 14 conceptually illustrates operation between an electronicapparatus and a display apparatus according to a fourth embodiment ofthe disclosure;

FIG. 15 is a flowchart showing a method of controlling the electronicapparatus according to the fourth embodiment of the disclosure;

FIG. 16 conceptually illustrates operation between an electronicapparatus and a display apparatus according to a fifth embodiment of thedisclosure;

FIG. 17 is a flowchart showing a method of controlling the electronicapparatus according to the fifth embodiment of the disclosure;

FIG. 18 is a flowchart showing a method of controlling the displayapparatus according to the fifth embodiment of the disclosure;

FIG. 19 illustrates an example of a user interface (UI) displayed on thedisplay apparatus according to the fifth embodiment of the disclosure;

FIG. 20 illustrates another example a UI displayed on the displayapparatus according to the fifth embodiment of the disclosure;

FIG. 21 illustrates another example a UI displayed on the displayapparatus according to the fifth embodiment of the disclosure;

FIG. 22 conceptually illustrates operation between an electronicapparatus and a display apparatus according to a sixth embodiment of thedisclosure; and

FIG. 23 is a flowchart showing a method of controlling the electronicapparatus according to the sixth embodiment of the disclosure.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

An aspect of the disclosure is to provide an electronic apparatus, adisplay apparatus, and a method of controlling the same, in which theelectronic apparatus capable of receiving and processing a user voiceautonomously processes the user voice or allows the display apparatus toselectively process the user voice, and provides process results inaccordance with on/off states of the display apparatus, therebyextending functions and services.

Further, an aspect of the disclosure is to provide an electronicapparatus, a display apparatus, and a method of controlling the same, inwhich the electronic apparatus autonomously processes a received uservoice or allows the display apparatus to selectively process the uservoice, and provides process results in accordance with service/contenttypes provided by voice processes, thereby receiving more efficientlythe service/content through a screen when visual feedback is needed.

Further, an aspect of the disclosure is to provide an electronicapparatus, a display apparatus, and a method of controlling the same, inwhich the electronic apparatus provides information about an error inprocessing a user voice to the display apparatus, so that the error canbe corrected through the display apparatus.

Below, exemplary embodiments will be described in detail with referenceto accompanying drawings. In the drawings, like numerals or symbolsrefer to like elements having substantially the same function, and thesize of each element may be exaggerated for clarity and convenience ofdescription. However, the configurations and functions illustrated inthe following exemplary embodiments are not construed as limiting thepresent inventive concept and the key configurations and functions. Inthe following descriptions, details about publicly known functions orfeatures will be omitted if it is determined that they cloud the gist ofthe present inventive concept.

In the following exemplary embodiments, terms ‘first’, ‘second’, etc.are only used to distinguish one element from another, and singularforms are intended to include plural forms unless otherwise mentionedcontextually. In the following exemplary embodiments, it will beunderstood that terms ‘comprise’, ‘include’, ‘have’, etc. do notpreclude the presence or addition of one or more other features,numbers, steps, operations, elements, components or combination thereof.In addition, a ‘module’ or a ‘portion’ may perform at least one functionor operation, be achieved by hardware, software or combination ofhardware and software, and be integrated into at least one module. Inthe disclosure, at least one among a plurality of elements refers to notonly all the plurality of elements but also both each one of theplurality of elements excluding the other elements and a combinationthereof.

FIG. 1 illustrates an electronic apparatus and a display apparatusaccording to an embodiment of the disclosure, and FIG. 2 illustrates anelectronic apparatus and a display apparatus according to anotherembodiment of the disclosure.

The electronic apparatus 10 according to an embodiment of the disclosuremay output a sound to thereby provide audio content to a user as shownin FIGS. 1 and 2.

The electronic apparatus 10 may be embodied by an output apparatusincluding at least one speaker (see ‘110’ in FIG. 3) as an output unitto output a sound. According to the disclosure, there are no limits tothe number, shape and position of speakers 110 provided in theelectronic apparatus 10.

The electronic apparatus 10 receives a voice uttered by a user(hereinafter, referred to as a user voice), and processes the voice toperform operation corresponding to the received voice. Here, theelectronic apparatus 10 may output a sound corresponding to a processresult of the user voice through the speaker 110 provided as the outputunit, as the operation corresponding to the received voice.

The electronic apparatus 10 may include at least one microphone (see‘120’ in FIG. 3) as an input unit to receive a user voice. According tothe disclosure, there are no limits to the number, shape and position ofmicrophones 120 provided in the electronic apparatus 10.

According to an embodiment, the electronic apparatus 10 may receive aninput audio signal (hereinafter, also referred to as an acoustic signal)from at least one external apparatus, for example, a television (TV) orthe like display apparatus 20 through a communicator (see ‘140’ in FIG.3), and processes the input audio signal to thereby generate an outputaudio signal. A sound corresponding to the processed audio signal may beoutput through the speaker 110.

According to the disclosure, the external apparatus capable of providingan audio signal to the electronic apparatus 10 is not limited to thedisplay apparatus 20 shown in FIGS. 1 and 2. The external apparatus may,for example, include various apparatuses such as a set-top box (STB), anaudio/video (A/V) receiver, a player for a digital versatile disc (DVD)or Blu-ray, or the like optical disc, a mobile apparatus, etc. toprovide an input audio signal to the electronic apparatus 10.

According to an embodiment, the electronic apparatus 10 may, as shown inFIG. 1, be embodied by an artificial intelligence (AI) speaker(hereinafter, also referred to as a smart speaker).

The AI speaker receives a voice of a user, and performs variousfunctions for listening music, searching information, etc. based onvoice recognition of the received voice. The AI speaker is not thespeaker for outputting a sound, but an apparatus with a built-in virtualsecretary/voice assistant capable of interaction with a user throughfunctions of voice recognition, a cloud infrastructure, etc., therebyproviding various services to the user.

The electronic apparatus 10 according to the disclosure embodied as theAI speaker is not limited to that shown in FIG. 1. According to anotherembodiment, the electronic apparatus 10 may for example be embodied inthe form of a sound bar installed under the display apparatus 20 asshown in FIG. 2, thereby functioning as the AI speaker.

According to still another embodiment, the electronic apparatus 10 maybe embodied by a laptop computer, a tablet computer, a mobile phone, amultimedia player, an MP3 player, a set-top box, and the like variousapparatuses capable of processing an audio signal and outputting a soundthrough the speaker provided therein or connected by wired or wirelesscommunication, thereby functioning as the AI speaker. In this case, anapplication for the function of the AP speaker may be installed anddriven in the electronic apparatus 10.

The electronic apparatus 10 may communicate with various externalapparatuses such as the display apparatus 20 and a server 30 through thecommunicator 140.

According to the disclosure, there are no limits to a communicationmethod between the electronic apparatus 10 and the external apparatus,and therefore the electronic apparatus 10 may be embodied to communicatewith the external apparatus through various wired or wireless connectionmethods (for example, Bluetooth, Wi-Fi, or Wi-Fi direct, etc.)

According to an embodiment, the electronic apparatus 10 performscommunication with the external apparatus such as the display apparatus20, identifies the state of the display apparatus 20 through thecommunicator 140, and autonomously processes a user voice or transmitsthe user voice or information about the user voice to the displayapparatus 20 through the communicator 140 to thereby make a request forthe process to the display apparatus 20 according to the identificationresults.

The display apparatus 20 may receive the information about the uservoice from the electronic apparatus 10 and process the user voice,thereby outputting a process result through a display (se ‘230’ in FIG.4). Further, the display apparatus 20 may transmit a signalcorresponding to the process result to the electronic apparatus 10, sothat the electronic apparatus 10 can output a sound based on the processresult.

The server 30 is provided to perform wired or wireless communicationwith the electronic apparatus 10 and the display apparatus 20. Theserver 30 may, for example, be embodied by a cloud type, and store andmanage a user account of the electronic apparatus 10 and the displayapparatus 20.

According to an embodiment, the server 30 may be provided with a datafor recognizing a voice uttered by a user, in other words, a database(DB) storing information. The database may, for example, include aplurality of acoustic models previously identified by modeling signalcharacteristics of a voice. Further, the database may further include alanguage model previously identified by modeling a linguistic sequencerelationship between words, syllables, etc. corresponding to lexiconstargeted for recognition.

The electronic apparatus 10 or the display apparatus 20 may be connectedto the server 30 through a wired or wireless network and access thedatabase, thereby identifying and processing a received user voice andoutputting a sound or image based on the process result.

Below, the configurations and operations of the electronic apparatus andthe display apparatus according to an embodiment of the disclosure willbe described in detail.

FIG. 3 is a block diagram of an electronic apparatus according to anembodiment of the disclosure.

As shown in FIG. 3, the electronic apparatus 10 according to anembodiment of the disclosure includes the speaker 110, the microphone120, a signal processor 130, the communicator 140, a storage 150, and aprocessor 160.

However, the configuration of the electronic apparatus 10 an embodimentof the disclosure shown in FIG. 3 is merely an example, and anelectronic apparatus according to another embodiment may be embodied byother configurations than the configuration shown in FIG. 3. In otherwords, the electronic apparatus of the disclosure may include anotherelement in addition to the elements shown in FIG. 3, or may exclude atleast one element from the elements shown in FIG. 3.

The speaker 110 outputs a sound. The speaker 110 may be, for example,provided to output a sound of an audible frequency band of 20 Hz to 20KHz. The speaker 110 may output a sound based on audio signalscorresponding to a plurality of channels.

According to an embodiment, the speaker 110 may output a sound based ona process of a user voice received through the microphone 120.

The microphone 120 may receive a voice uttered by a user, in otherwords, a sound wave.

The sound wave input to the microphone 120 is converted into an electricsignal by a signal converter. According to an embodiment, the signalconverter may include an analog-to-digital (AD) converter for convertingan analog sound wave into a digital signal. Further, according to anembodiment, the signal converter may be included in the signal processor130 to be described later.

According to an embodiment of the disclosure, the microphone 120 may beprovided in the electronic apparatus 10 itself.

However, according to another embodiment, the microphone 120 may be notincluded in the electronic apparatus 10 but provided in a separateapparatus.

For example, a mobile apparatus such as a smartphone capable ofreceiving a user voice is given as an example of the separate apparatusin which the microphone 120 is provided. In this case, a user voicereceived in the mobile apparatus may be converted into an electricsignal (i.e. a voice signal) and then transmitted to the electronicapparatus 10. Here, when the electronic apparatus 10 is embodied by theAI speaker, the electronic apparatus may be stored and installed with anAI speaker application for linking with the AI speaker, and theelectronic apparatus may receive a voice uttered by a user while the AIspeaker application is executed and activated.

Alternatively, a user voice may be received through a microphoneinstalled in a remote controller provided as an input unit of thedisplay apparatus 20 or the display apparatus 20, and the electronicapparatus 10 may receive a voice signal corresponding to the user voicefrom the display apparatus 20.

The signal processor 130 processes an audio signal (i.e. an acousticsignal). The audio signal processed in the signal processor 130 isoutput as a sound through the speaker 110, and thus provided as audiocontent to a user.

The signal processor 130 may be embodied by a digital signal processor(DSP) or the like microprocessor.

According to an embodiment, the signal processor 130 may be embodied asincluded in a main system-on-chip (SoC) mounted to a printed circuitboard (PCB) internally provided in the electronic apparatus 10.According to an embodiment, the main SoC may further include a centralprocessing unit (CPU) or an application processor (AP) as an example ofthe processor 160 (to be described later).

The communicator 140 performs communication with various externalapparatuses such as the display apparatus 20, the server 30, a mobileapparatus, etc.

The communicator 140 may be embodied as a communication circuitryincluding wireless communication modules (e.g. a software (S/W) module,a chip, etc.) corresponding to various communication protocols.

According to an embodiment, the communicator 140 includes a wirelesslocal area network (WLAN) unit. The WLAN unit may wirelessly beconnected to the external apparatus through an access point (AP) undercontrol of the processor 160. The WLAN unit includes a Wi-Ficommunication module.

According to an embodiment, the communicator 140 includes a short-rangecommunication module that supports wireless direct communication betweenthe electronic apparatus 10 and the external apparatus without the AP.The short-range communication module may support at least one amongWi-Fi direct, Bluetooth, Bluetooth low energy, RF communication, IR dataassociation (IrDA), Zigbee, ultra-wideband (UWB), and near fieldcommunication (NFC). When the electronic apparatus 10 performs directcommunication with the external apparatus, the storage 150 may storeidentification information (e.g. media access control (MAC) address orIP address) about the external apparatus targeted for the communication.

In the electronic apparatus 10 according to an embodiment of thedisclosure, the communicator 140 is provided to perform the wirelesscommunication with the external apparatus through at least one of theWLAN unit or the short-range communication module according toperformance.

According to another embodiment, the communicator 140 may includeEthernet or the like wired communication module. Alternatively, thecommunicator 140 may further include communication modules based onvarious communication methods such as long-term evolution or the likemobile telecommunication, magnetic field or the like electromagnetic(EM) communication, visible light communication, etc.

According to an embodiment, the communicator 140 may include connectorsto transmit/receive a signal/data based on high definition multimediainterface (HDMI), universal serial bus (USB), Component, and the likestandards. Here, the communicator 140 may include at least one connectoror terminal corresponding to these standards.

According to an embodiment, the communicator 140 may transmitpredetermined data as information about a user voice received throughthe microphone 120 to the external apparatus, in other words, thedisplay apparatus 20. Here, there are no limits to the format/kind ofdata to be transmitted, and the data may for example include an audiosignal corresponding a voice uttered by a user, voice features extractedfrom the audio signal, etc.

Further, the communicator 140 may receive data as a result of processingthe user voice from the display apparatus 20. The electronic apparatus10 outputs a sound corresponding to a voice process result, based on thereceived data, through the speaker 110.

The storage 150 is configured to store various pieces of data of theelectronic apparatus 10. The storage 150 may be embodied by anonvolatile memory (or a writable read only memory (ROM)) which canretain data even though the electronic apparatus 10 is powered off andreflect changes. That is, the storage 150 may include one of a flashmemory, an electrically programmable ROM (EPROM) or an electricallyerasable and programmable ROM (EEPROM).

The storage 150 may further include a volatile memory such as a dynamicrandom access memory (DRAM) or static RAM (SRAM), of which reading orwriting speed for the electronic apparatus 10 is faster than that of thenonvolatile memory.

Data stored in the storage 150 may for example include not only anoperating system (OS) for driving the electronic apparatus 10 but alsovarious software, programs, applications, appended data, etc. executableon the OS.

In the electronic apparatus 10 according to an embodiment of thedisclosure, the application stored and installed in the storage 150 mayinclude the AI speaker application to recognize a user voice receivedthrough the microphone 120 and perform operation based on therecognition. According to an embodiment, the AI speaker application isexecuted or activated when a predetermined keyword input through themicrophone 120, a user's control on a specific button for the electronicapparatus 10, etc. is identified, thereby applying a voice recognitionfunction to a voice uttered by a user. Here, the activation of theapplication may include switching over the running state of theapplication from a background mode to a foreground mode.

In the electronic apparatus 10 according to an embodiment, the storage150 may, as shown in FIG. 3, include a database 151 in which data, i.e.information is stored to recognize a user voice receivable through themicrophone 120.

The database 151 may, for example, include a plurality of acousticmodels previously identified by modeling signal characteristics of avoice. Further, the database 151 may further include a language modelpreviously identified by modeling a linguistic sequence relationshipbetween words, syllables, etc. corresponding to lexicons targeted forrecognition.

Alternatively, the database stored with information for recognizing theuser voice may be provided in the server 30 given as an example of theexternal apparatuses connectable to the wired or wireless networkthrough the communicator 140 as described above. The server 30 may, forexample, be embodied by the cloud type.

The processor 160 performs control for operating general elements of theelectronic apparatus 10.

The processor 160 executes a control program (or an instruction) toperform such a control operation, and executes the loaded controlprogram. The processor 160 may be embodied by at least onegeneral-purpose processor, for example, the CPU or the applicationprocessor (AP), which loads at least a part of the control program fromthe nonvolatile memory installed with the control program into thevolatile memory and executes the loaded control program.

The processor 160 include a single-core processor, a dual-coreprocessor, a triple-core processor, a quad-core processor, or the likemultiple-core processor. The processor 160 may include a plurality ofprocessors, for example, a main processor and a sub processor thatoperates in a sleep mode (e.g. when the electronic apparatus does notfully operate while being supplied with only standby power). Further,the processor, the ROM, and the RAM are connected to one another throughan internal bus, and the ROM and the RAM are included in the storage150.

According to the disclosure, the CPU or the application processorembodied as the processor 160 may be included in a main SoC mounted to aPCB internally provided in the electronic apparatus 10. According to anembodiment, the main SoC may further include the foregoing signalprocessor 130.

The control program may include a program(s) embodied by at least one ofa basic input/output system (BIOS), a device driver, an OS, a firmware,a platform, or an application. According to an embodiment, theapplication may be previously installed or stored in the electronicapparatus 10 when the electronic apparatus 10 is manufactured, or may beinstalled in the electronic apparatus 10 based on application datareceived from the outside when it is required in the future. Theapplication data may for example be downloaded from an external serversuch as an application market to the electronic apparatus 10. Such anexternal server is merely an example of a computer program productaccording to the disclosure, but not limited thereto.

The processor 160 may, as shown in FIG. 3, include a voice recognitionmodule 161 (hereinafter, also referred to as a voice recognition engine)capable of recognizing a voice uttered by a user.

According to an embodiment, the voice recognition function of the voicerecognition module 161 may be performed based on one or more voicerecognition algorithms. For example, the voice recognition module 161extracts a vector of voice features from a user voice, and compares theextracted vector with the acoustic model of the server 30 or thedatabase 151, thereby performing the voice recognition. Here, theacoustic model may for example be a model based on previously performedlearning.

An embedded type of the voice recognition module 161 resident in the CPUprovided as the processor 160 is described by way of example, but thedisclosure is not limited to this example. Alternatively, the voicerecognition module 161 may be embodied by an element of the electronicapparatus 10 separated from the CPU, for example, by a microcomputer(MICOM) or the like separate chip as a dedicated processor for the voicerecognition function.

According to an embodiment, the processor 160 may identify the state ofthe display apparatus 20 provided as the external apparatus through thecommunicator 140 based on the user voice received through the microphone120, and process the received user voice and output a soundcorresponding to a process result through the speaker 110 or control thecommunicator 140 to transmit the received user voice to the displayapparatus 20 and make a request for processing the voice to the displayapparatus 20 according to the identification results.

According to an embodiment, the operations of the processor 160 may becarried by a computer program stored in a computer program product (notshown) provided separately from the electronic apparatus 10. In thiscase, the computer program product includes a memory in whichinstructions corresponding to the computer programs are stored, and aprocessor. When the instruction is executed by the processor 160, theinstruction includes identifying the state of the display apparatus 20based on reception of the user voice, and processing the received uservoice and outputting a sound corresponding to a process result orcontrolling the communicator 140 to transmit the received user voice tothe display apparatus 20 and make a request for processing the voice tothe display apparatus 20 according to the identification results.

Therefore, the processor 160 of the electronic apparatus 10 may downloadand execute a computer program stored in a separate computer programproduct, and perform the foregoing operations of the instructions.

FIG. 4 is a block diagram of a display apparatus according to anembodiment of the disclosure.

According to an embodiment of the disclosure, the display apparatus 20displays an image by processing an image signal from an external signalsource, i.e. an image source according to preset processes.

According to an embodiment, the display apparatus 20 may include a TVthat processes a broadcast signal based on at least one of abroadcasting signal, broadcast information or broadcast data from atransmitter of a broadcasting station and displays an image based on thebroadcast signal.

According to the disclosure, there are no limits to the kinds of imagesources for providing content, and the display apparatus 20 may, forexample, receive an image signal from a STB, a player for an opticaldisc such as Blu-ray disc or DVD, a personal computer (PC) such as adesktop or laptop computer, a game console, a mobile device including asmart pad such as a smartphone or a tablet computer, etc.

When the display apparatus 20 is the TV, the display apparatus 20 maywirelessly receive a radio frequency (RF) signal, i.e. a broadcastsignal from the broadcasting station. To this end, the display apparatus20 may include an antenna configured to receive a broadcast signal, anda tuner configured to be tuned to a channel corresponding to a broadcastsignal.

In the display apparatus 20, the broadcast signal may be receivedthrough a terrestrial wave, a cable, a satellite, etc., and a signalsource is not limited to the external apparatus or the broadcastingstation. That is, any apparatus or station capable of transmitting andreceiving data may be included in the image source according to theembodiment.

Standards for a signal received in the display apparatus 20 may bevariously given corresponding to the types of the apparatus, and imagecontent may for example be received based on a high definitionmultimedia interface (HDMI), a display port (DP), a digital visualinterface (DVI), composite video, component video, super video, Syndicatdes Constructeurs d'Appareils Radiorécepteurs et Téléviseurs (SCART),USB, etc. by a wire.

The display apparatus 20 may receive image content from a server or thelike prepared for providing content through wired or wireless networkcommunication, and there are no limits to the kinds of communication.

According to an embodiment, the display apparatus 20 may perform atleast one of wireless communication using an access point (AP) orwireless communication directly connected to other apparatuses the AP.For example, the display apparatus 20 may receive content from an imagesource through the wireless network communication such as Wi-Fi, Wi-FiDirect, Bluetooth, Bluetooth low energy, Zigbee, UWB, NFC, etc.Alternatively, the display apparatus 20 may receive content throughEthernet or the like wired network communication.

Further, according to an alternative embodiment, the display apparatus20 may receive content through Ethernet or the like wired networkcommunication.

Further, according to an embodiment, the display apparatus 20 may serveas the AP through which various peripheral devices such as a smartphonecan perform the wireless communication.

The display apparatus 20 may receive content provided in the form of areal-time streaming file through a wired or wireless network.

Further, the display apparatus 20 may perform a signal process todisplay thereon a moving image, a still image, an application, anon-screen display (OSD), a UI (hereinafter also referred to as a graphicuser interface (GUI) for various operation controls, etc. based on asignal/data stored in an internal/external storage medium.

According to an embodiment, the display apparatus 20 may operate as asmart TV or an Internet protocol (IP) TV. The smart TV refers to a TVthat can receive and display a broadcast signal in real time, support aweb browsing function so that various pieces of content can be searchedand consumed through the Internet while a broadcast signal is displayedin real time, and provide a convenient user environment for the webbrowsing function. Further, the smart TV includes an open softwareplatform to provide an interactive service to a user. Therefore, thesmart TV is capable of providing various pieces of content, for example,an application for a predetermined service to a user through the opensoftware platform. Such an application refers to an application programfor providing various kinds of services, for example, a social networkservice (SNS), finance, news, weather, a map, music, a movie, a game, anelectronic book, etc.

The display apparatus 20 according to an embodiment of the disclosuremay, as shown in FIG. 4, include a signal receiver 210, an imageprocessor 220, a display 230, a communicator 240, a storage 250, aprocessor 260, and a user input receiver 270.

However, the configuration of the display apparatus 20 an embodiment ofthe disclosure shown in FIG. 4 is merely an example, and a displayapparatus according to another embodiment may be embodied by otherconfigurations than the configuration shown in FIG. 4. In other words,the display apparatus of the disclosure may include another element inaddition to the elements shown in FIG. 4, or may exclude at least oneelement from the elements shown in FIG. 4.

The signal receiver 210 receives a signal, i.e. image content from anexternal image source. According to an embodiment, the signal receiver210 may include a tuner configured to be tuned to a channelcorresponding to a broadcast signal.

According to an embodiment, the signal receiver 210 includes a connectorto which the image source is connected by a wire. The display apparatus20 may receive content from the image source connected to the connectorby a wire through the connector.

The connector may be embodied as a communication circuitry including adata input/output interface where communication modules (e.g. a S/Wmodule, a chip, etc.), port, etc. are combined corresponding to variouskinds of communication protocols.

According to an embodiment, the connector may for example be configuredto transmit/receive a signal/data based on HDMI, HDMI consumerelectronics control (CEC), USB, Component, and the like standards, andinclude at least one connector or terminal corresponding to thesestandards.

The connector basically receives a signal from the image source, but mayinteractively transmit and receive a signal.

According to an embodiment, the image source connected to the displayapparatus 20 by a wire through the connector is the set-top box, the PCor the like external apparatus, but the disclosure is not limited tothis embodiment. For example, the display apparatus 20 according to analternative embodiment may connect with a mobile apparatus by a wirethrough the connector.

The image processor 220 performs various preset image processingprocesses with regard to received content, i.e. image signal. The imageprocessor 220 outputs an image signal generated or combined byperforming such image processing processes to the display 230, so thatthe display 230 can display an image based on the image signal. Theimage signal processed by the image processor 220 may be based on datastored in the flash memory, the HDD, or the like nonvolatile storage250.

The image processor 220 may include a decoder for decoding the imagesignal to correspond to the image format for the display apparatus 20,and a scaler for adjusting the image signal to correspond to the outputstandards for the display 230.

According to an embodiment, the decoder may for example be embodied byan H.264 decoder, but not limited thereto. In other words, the videodecoder in this embodiment may for example be embodied by a movingpicture experts group (MPEG) decoder, a high efficiency video codec(HEVC) decoder, or the like decoders corresponding to variouscompression standards.

According to the disclosure, there are no limits to the kinds of contentto be processed by the image processor 220. For example, the contentprocessed by the image processor 220 includes not only a videoclip andthe like moving image, but also a joint photographic experts group(JPEG) file and the like picture, a background image and the like stillimage, etc.

There are no limits to the kinds of processes performed by the imageprocessor 220, and the image processor 220 may for example furtherperform at least one among various processes such as de-interlacing forconverting an interlaced type broadcast signal into a progressive typebroadcast signal, detail enhancement, frame refresh rate conversion,line scanning, etc.

The image processor 220 may be embodied in the form of a group ofindividual elements for independently performing such processes, or maybe embodied as included in a main SoC where many functions areintegrated. The main SoC may further include at least one applicationprocessor or CPU embodied as an example of the processor 260 (to bedescribed later).

According to an embodiment, the image processor 220 may be embodied byan image board that various chipsets, a memory, electronic parts,wiring, and the like circuit configuration for performing such processesare mounted to a PCB. In this case, the display apparatus 20 may includea single image board on which the image processor 220 and the processor260 are provided. Of course, this is merely an example. Alternatively,the tuner, the video processor, and the controller may be provided on aplurality of PCBs connected for communication with each other.

The signal generated or combined by the process of the image processor220 is output to the display 230.

The display 230 displays an image based on the signal received from theimage processor 220 on a screen thereof.

There are no limits to the types of the display 230, and the display 230may be embodied by various display types such as liquid crystal, plasma,a light-emitting diode, an organic light-emitting diode, asurface-conduction electron-emitter, a carbon nano-tube, nano-crystal,etc.

According to an embodiment, the display 230 includes a display panel fordisplaying an image thereon, and may further include an additionalelement (e.g. a driver) according to its types. The driver may includeone or more driver integrated circuits (IC), and output an electricsignal for driving electronic devices of a light source or a screen sothat the display 230 can display an image based on a signal receivedfrom the image processor 220.

The communicator 240 communicates with various external apparatuses suchas the electronic apparatus 10, the server 30, etc.

The communicator 240 is embodied by various communication methodscorresponding to the external apparatus including the electronicapparatus 10 and the server 30.

The communicator 240 may be embodied by a communication circuitryincluding wireless communication modules (an S/W module, a chip, etc.),etc. corresponding to various kinds of communication protocols.

According to an embodiment, the communicator 240 includes a wirelesslocal area network (WLAN) unit. The WLAN unit may connect with at leastone external apparatus through the access point (AP) under control ofthe processor 260. The WLAN unit may include a Wi-Fi communicationmodule.

According to an embodiment, the communicator 240 includes a short-rangecommunication module that supports wireless direct communication betweenthe display apparatus 20 and the external apparatus without the AP. Theshort-range communication module may support at least one among Wi-Fidirect, Bluetooth, Bluetooth low energy, RF communication, IrDA, Zigbee,UWB, and NFC. When the display apparatus 20 performs directcommunication with the external apparatus, the storage 250 may storeidentification information (e.g. MAC address or IP address) about theexternal apparatus targeted for the communication.

In the display apparatus 20 according to an embodiment of thedisclosure, the communicator 240 is provided to perform the wirelesscommunication with the external apparatus through at least one of theWLAN unit or the short-range communication module according toperformance.

According to an embodiment, the communicator 240 may further include awired communication module such as Ethernet, etc.

According to an embodiment, the communicator 240 may receive data asinformation about a user voice from the electronic apparatus 10. Here,there are no limits to the format/kind of data to be received, and thedata may for example include an audio signal corresponding a voiceuttered by a user, voice features extracted from the audio signal, etc.

Further, the communicator 240 may output data a voice process resultbased on the information about the received user voice to the electronicapparatus 10. The electronic apparatus 10 outputs a sound correspondingto the voice process result, based on the received data, through thespeaker 110.

The storage 250 may be configured to store various pieces of data of thedisplay apparatus 20. The storage 250 may be embodied by a nonvolatilememory (or a writable ROM) which can retain data even though the displayapparatus 20 is powered off, and mirror changes. That is, the storage250 may include at least one among a flash memory, an HDD, an EPROM oran EEPROM.

The storage 250 may further include a volatile memory such as a RAM, andthe volatile memory may be provided as a DRA) or SRAM, of which readingor writing speed for the display apparatus 20 is faster than that of thenonvolatile memory.

In this specification, the term ‘storage’ is defined to include not onlythe nonvolatile memory but also the volatile memory, a cache memoryprovided in the processor 260, a memory card (e.g. a micro SD card, amemory stick, etc.) mountable to the display apparatus 20 through theconnector according to predetermined standards, etc.

Data stored in the storage 250 may for example include not only an OSfor driving the display apparatus 20 but also various software,programs, applications, image data, graphic data, appended data, etc.executable on the OS.

The graphic data is output to the display 230 as an image signalprocessed by the image processor 220, and may be displayed as graphicssuch as OSD, a GUI (hereinafter also referred to as a “UI”), etc. in acertain area on the screen of the display 230.

In the display apparatus 20 according to an embodiment of thedisclosure, the application stored and installed in the storage 250 mayinclude the AI speaker application to recognize a user voice receivedthrough the main body, the remote controller, etc. of the electronicapparatus 10 or the display apparatus 20 and perform operation based onthe recognition. According to an embodiment, the AI speaker applicationis executed or activated when the display apparatus 20 is turned on by arequest from the electronic apparatus 10 that receives the user voice,thereby applying a voice recognition function to the user voice receivedfrom the electronic apparatus 10. Here, the activation of theapplication may include switching over the running state of theapplication from a background mode to a foreground mode.

In the display apparatus 20 according to an embodiment, the storage 250may, as shown in FIG. 4, include a database 251 in which data, i.e.information is stored to recognize a user voice received from theelectronic apparatus 20.

The database 251 may, for example, include a plurality of acousticmodels previously identified by modeling signal characteristics of avoice. Further, the database 251 may further include a language modelpreviously identified by modeling a linguistic sequence relationshipbetween words, syllables, etc. corresponding to lexicons targeted forrecognition.

Alternatively, the database stored with information for recognizing theuser voice may be provided in the server 30 given as an example of theexternal apparatuses connectable to the wired or wireless networkthrough the communicator 240 as described above. The server 30 may, forexample, be embodied by the cloud type.

The processor 260 performs control for operating general elements of thedisplay apparatus 20.

The processor 260 executes a control program (or an instruction) toperform such a control operation, and executes the loaded controlprogram. The processor 260 may be embodied by at least onegeneral-purpose processor, for example, the CPU or the applicationprocessor (AP), which loads at least a part of the control program fromthe nonvolatile memory installed with the control program into thevolatile memory and executes the loaded control program.

The processor 260 include a single-core processor, a dual-coreprocessor, a triple-core processor, a quad-core processor, or the likemultiple-core processor. Further, the processor, the ROM, and the RAMare connected to one another through an internal bus, and the ROM andthe RAM are included in the storage 250.

According to an embodiment, the processor 260 may include a plurality ofprocessors. In other words, the processor 260 may, as shown in FIG. 4,include a first processor 261 provided as a main processor, and a secondprocessor 262 provided as a sub processor.

The second processor 262 may operate in a standby mode, i.e. a sleepmode (e.g. when the display apparatus is supplied with only standbypower and does not serve to display an image).

When the display apparatus 20 is in the standby mode, the firstprocessor 261 maintains a power-saving state, in other words, aturned-off state. Here, the turned-off state refers to a kind of softturned-off state in which power supplied to the display apparatus 20 isnot completely shut off. When the display apparatus 20 in the standbymode receives a user input through the user input receiver 270 to bedescribed later or receives a signal from the electronic apparatus 10,the second processor 262 detects such reception and wakes up the firstprocessor 261. The first processor 261 is switched over from theturned-off state to a turned-on state, and it is thus possible toidentify a mode change of the display apparatus 20, i.e. from theturned-off state of the standby mode to the turned-on state of a normalmode.

According to an embodiment, the CPU or application processor embodied asan example of the processor 260 according to the disclosure may beembodied as included in the main SoC mounted to the PCB internallyprovided in the display apparatus 20. According to an embodiment, themain SoC may further include the foregoing image processor 220.

The control program may include a program(s) achieved by at least one ofa BIOS, a device driver, an OS, a firmware, a platform, or anapplication. According to an exemplary embodiment, the application maybe previously installed or stored in the display apparatus 20 when thedisplay apparatus is manufactured, or may be installed in the displayapparatus 20 on the basis of application data received from the outsidewhen it is required in the future. The application data may for examplebe downloaded from an external server such as an application market tothe display apparatus 20. Such an external server is merely an exampleof the computer program product according to the disclosure, but notlimited thereto.

The processor 260 may, as shown in FIG. 4, include a voice recognitionmodule 263 (hereinafter, also referred to as a voice recognition engine)capable of recognizing a voice uttered by a user.

According to an embodiment, the voice recognition function of the voicerecognition module 263 may be performed based on one or more voicerecognition algorithms. For example, the voice recognition module 263extracts a vector of voice features from a user voice, and compares theextracted vector with the acoustic model of the database 251, therebyperforming the voice recognition. Here, the acoustic model may forexample be a model based on previously performed learning.

An embedded type of the voice recognition module 263 resident in the CPUprovided as the processor 260 is described by way of example, but thedisclosure is not limited to this example. Alternatively, the voicerecognition module 263 may be embodied by an element of the displayapparatus 20 separated from the CPU, for example, by a microcomputer(MICOM) or the like separate chip as a dedicated processor for the voicerecognition function.

According to an embodiment, the processor 260 may receive informationabout a user voice from the electronic apparatus 10 provided as theexternal apparatus through the communicator 240 based on the identifiedchange in the display apparatus 20 from the turned-off state (i.e. thestandby mode) to the turned-on state (i.e. the normal mode), process theuser voice, and control the display 230 to display an image based on aprocess result.

According to an embodiment, the operation of the processor 260 may beembodied by a computer program stored in the computer program product(not shown) provided separately from the display apparatus 20. In thiscase, the computer program product includes a memory in which aninstruction corresponding to a computer program is stored, and aprocessor. When the instruction is executed by the processor 260, theinstruction includes receiving information about a user voice from theelectronic apparatus 10 provided as the external apparatus through thecommunicator 240 based on the identified change in the display apparatus20 from the turned-off state (i.e. the standby mode) to the turned-onstate (i.e. the normal mode), processing the user voice, and controllingthe display 230 to display an image based on a process result.

Therefore, the processor 260 of the display apparatus 20 may downloadand execute a computer program stored in a separate computer programproduct, and perform the foregoing operations of the instructions.

The user input receiver 270 transmits various preset control commands orunrestricted information to the processor 260 in response to a userinput.

The user input receiver 270 include a control panel (or an input panel)provided as a keypad including a power key, a numeral key, a menu keyand the like buttons provided on the main body of the display apparatus20.

According to an embodiment, the user input receiver 270 includes aninput device that generates a command/data/information/signal previouslyset for remotely controlling the display apparatus 20, and transmits thecommand/data/information/signal to the display apparatus 20. The inputdevice includes a remote controller, a keyboard, a mouse, etc. andreceives a user input as being separated from the main body of thedisplay apparatus 20. The remote controller may include a touch sensorto detect a user's touch input and/or a motion sensor to detect its ownmotion caused by a user. The input device includes a smartphone or thelike terminal in which a remote control application is installed. Inthis case, it is possible to receive a user's touch input through atouch screen.

The input device serves as the external apparatus capable of performingwireless communication with the main body of the display apparatus 20,and the wireless communication includes Bluetooth, IrDA, RFcommunication, WLAN, Wi-Fi direct, etc.

According to an embodiment, the user input receiver 270 may furtherinclude a microphone to receive a voice uttered by a user/the sound, inother words, a user voice, and the microphone may be provided in themain body of the display apparatus 20, the remote controller, etc.

Below, embodiments that the user voice is processed in the electronicapparatus or the display apparatus according to the disclosure will bedescribed with reference to the accompanying drawings.

FIGS. 5 and 6 conceptually illustrate operation between an electronicapparatus and a display apparatus according to a first embodiment of thedisclosure, FIG. 7 is a flowchart showing a method of controlling theelectronic apparatus according to the first embodiment of thedisclosure, FIG. 8 illustrates an example that the electronic apparatusaccording to the first embodiment of the disclosure processes a uservoice, and FIG. 9 illustrates an example that the display apparatusaccording to the first embodiment of the disclosure processes a uservoice.

The electronic apparatus 10 according to the first embodiment of thedisclosure may, as shown in FIGS. 5 and 6, identify the power state ofthe display apparatus 20, i.e. whether the display apparatus 20 is inthe turned-on state or the turned-off state, based on the user voicereceived through the microphone 120, and operate in a TV-off mode or aTV-on mode based on the identification result.

The electronic apparatus 10 may operate in the TV-off mode (or anexclusive use mode) as shown in FIG. 5 based on the identifiedturned-off state of the display apparatus 20, thereby processing thereceived user voice and outputting a process result as a sound throughthe speaker 110.

The electronic apparatus 10 may operate in the TV-on mode (or a TV linkmode) as shown in FIG. 6 based on the identified turned-on state of thedisplay apparatus 20, thereby transmitting the information about thereceived user voice to the display apparatus 20 through the communicator140, and making a request for processing the voice to the displayapparatus 20. The display apparatus 20 processes the user voice, andoutputs a process result as an image through the display 230.

Specifically, as shown in FIG. 7, the electronic apparatus 10 mayreceive a user voice uttered by a user through the microphone 120 (401).The electronic apparatus 10 may receive various unrestricted user voicesthrough the microphone 120, and may for example, as shown in FIG. 8,receive a voice corresponding to a searching request.

According to an embodiment, the processor 160 may detect a predeterminedkeyword uttered by a user (hereinafter, referred to as a wake-upkeyword), for example, “Hi, Bixby” as shown in FIG. 8, therebyidentifying that the user voice is received through the microphone 120.One or more wake-up keywords may be previously set by the manufacturerof the electronic apparatus 10, a service provider, etc. or may be setby a user.

Here, when it is identified that a predetermined keyword is input as theuser voice through the microphone 120, the processor 160 may execute oractivate the AI speaker application installed in the electronicapparatus 10. For example, when it is identified that “Hi, Bixby” or thelike wake-up keyword is input, the processor 160 may switch the runningstate of the AI speaker application over from the background mode to theforeground mode.

Based on the user voice received in the operation 401, the processor 160identifies the state of the external apparatus, i.e. the displayapparatus 20 through the communicator 140 (402). For example, theprocessor 160 transmits a preset signal to the display apparatus 20through the communicator 140, and identify the power state of thedisplay apparatus 20, in other words, whether the display apparatus 20is in the turned-on or turned-off state, according to whether a responsesignal to the preset signal is received from the display apparatus 20.

Based on the identification in the operation 402, it may be identifiedthat the display apparatus 20 is in the turned-on state or theturned-off state (403).

When it is identified in the operation 403 that the display apparatus 20is in the turned-off state, the processor 160 may process the user voicereceived in the operation 401 (404).

Specifically, the electronic apparatus 10 may operate in the TV-offmode, so that the processor 160 can apply the voice recognition to theuser voice and process the user voce to thereby perform an operationbased on a result of the voice recognition.

The processor 160 may control the signal processor 130 to convert theuser voice, i.e. a sound wave received through the microphone 120 intoan electric signal.

According to an embodiment, the voice recognition module 161 of theprocessor 160 may perform the voice recognition by extracting a vectorof voice features from a signal of a converted user voice, and comparingthe extracted vector with the acoustic model of the server 30 or thedatabase 151.

The processor 160 performs operations to process the user voice based onthe foregoing voice recognition, and output the process result.

For example, as shown in FIG. 8, when the user voice is related to arequest for searching for local restaurants, the processor 160 mayperform searching through the communicator 140, and control the signalprocessor 130 to generate an audio feedback, i.e. a response voice basedon the process result (i.e. a searching result).

The processor 160 may output a sound corresponding to the process resultof the operation 404 through the speaker 110 (405). For example, whenthe user voice processed in the operation 404 is related to a requestfor searching for local restaurants, a sound based on the searchingresult is output through the speaker 110 as shown in FIG. 8. This soundcorresponds to the response voice generated in the operation 404.

Meanwhile, when it is identified in the operation 403 that the displayapparatus 20 is in the turned-on state, the processor 160 may transmitinformation about the user voice received in the operation 401 to thedisplay apparatus 20 and makes a request for processing the voice to thedisplay apparatus 20 (406).

Here, the electronic apparatus 10 operates in the TV-on mode, so thatthe processor 160 can control the signal processor 130 to convert theuser voice, i.e. a soundwave received through the microphone 120 into anelectric signal, and transmit data about the converted signal as theinformation about the user voice to the display apparatus 20 through thecommunicator 140.

The processor 260 of the display apparatus 20 may apply the voicerecognition to the user voice, and process the user voice to therebyperform an operation based on a result of the voice recognition. Here,when the information about the user voice is received from theelectronic apparatus 10, the processor 260 may execute or activate theAI speaker application installed in the display apparatus 20, in whichthe activation include switching over the running state of the AIspeaker application from the background mode to the foreground mode.

According to an embodiment, the voice recognition module 263 of theprocessor 260 extracts a vector of voice features from information aboutthe received user voice, and compares the extracted vector with theacoustic model of the database 251 or the server 30, thereby performingthe voice recognition.

The processor 260 of the display apparatus 20 performs operations toprocess the user voice based on the voice recognition as describedabove, and output the process result.

For example, as shown in FIG. 9, when the user voice is related to arequest for searching for local restaurants, the processor 260 mayperform searching through the communicator 240, and control the display230 to display a UI 501 showing the search result. Here, a plurality ofitems 502 selectable by a user may be listed in the UI 501 showing thesearch result. When a user selects one item 502 in the list, theprocessor 260 may control the display 230 to display additionalinformation about the selected item, for example, a map, contactinformation, user reviews, etc., thereby allowing the user to furtherobtain various pieces of information.

FIG. 9 shows an example that the request for searching for restaurantsor the like is received as the user voice and the searching results aredisplayed, but there are no limits to a target to be processed orsearched based on the user voice according to the disclosure. Forexample, various user voices related to a TV service such as TV channelsearching, program/content searching, etc. may be processed.

Further, the processor 260 may output a signal corresponding to theprocess result (or the searching result) to the electronic apparatus 10through the communicator 240.

The processor 160 of the electronic apparatus 10 may receive the processresult of the operation 406 from the display apparatus 20, and output acorresponding sound through the speaker 110 (407). For example, when theprocess for the user voice in the operation 406 includes searching forlocal restaurants or the like, the searching result may be not onlydisplayed on the display apparatus 20 but also output as a soundcorresponding to the audio feedback, i.e. the response voice through thespeaker 110 as shown in FIG. 9.

According to the first embodiment of the disclosure, the electronicapparatus 10 autonomously processes the user voice or allows theexternal apparatus, i.e. the display apparatus 20 to selectively processthe user voice according to whether the external apparatus, i.e. thedisplay apparatus 20 with which the electronic apparatus 10 cancommunicate is in the turned-off state or the turned-on state.Therefore, as compared with the case where only the audio feedback isgiven through the electronic apparatus 10, the visual feedback isfurther provided through the screen of the display apparatus 20, therebyimproving a user's accessibility to the process result, and increasingconvenience as additional information is more easily obtained asnecessary.

FIG. 10 conceptually illustrates operation between an electronicapparatus and a display apparatus according to a second embodiment ofthe disclosure, and FIG. 11 is a flowchart showing a method ofcontrolling the electronic apparatus according to the second embodimentof the disclosure.

The electronic apparatus 10 according to the second embodiment of thedisclosure may, as shown in FIG. 10, identify the power state of thedisplay apparatus 20, i.e. whether the display apparatus 20 is in theturned-on state or the turned-off state, based on the user voicereceived through the microphone 120, and transmit a request for turningon the display apparatus 20 when it is identified that the displayapparatus 20 is in the turned-off mode.

Here, the electronic apparatus 10 may output a sound for guiding a userto turn on the display apparatus 20 of the turned-on state through thespeaker 110, and the display apparatus 20 may be switched over from theturned-off state to the turned-on state in response to the request fromthe electronic apparatus 10.

The electronic apparatus 10 operates in the TV-on mode (or the TV linkmode) as shown in FIG. 10 based on the switching of the displayapparatus 20 from the turned-off state to the turned-on state. Theelectronic apparatus 10 operates in the TV-on mode, thereby transmittingthe information about the received user voice to the display apparatus20 through the communicator 140, and making a request for processing thevoice to the display apparatus 20. The display apparatus 20 processesthe user voice, and outputs a process result as an image through thedisplay 230.

Specifically, as shown in FIG. 11, the electronic apparatus 10 mayreceive a user voice uttered by a user through the microphone 120 (601).Here, the electronic apparatus 10 may receive various unrestricted uservoices through the microphone 120.

According to an embodiment, the processor 160 may detect a predeterminedkeyword uttered by a user (i.e. the wake-up keyword), therebyidentifying that the user voice is received through the microphone 120.

When it is identified that a predetermined keyword is input as the uservoice through the microphone 120, the processor 160 may execute oractivate the AI speaker application installed in the electronicapparatus 10, in which the activation includes switching over therunning state of the AI speaker application from the background mode tothe foreground mode.

Based on the user voice received in the operation 601, the processor 160identifies the state of the external apparatus, i.e. the displayapparatus 20 through the communicator 140 (602). For example, theprocessor 160 transmits a preset signal to the display apparatus 20through the communicator 140, and identify the power state of thedisplay apparatus 20, in other words, whether the display apparatus 20is in the turned-on or turned-off state, according to whether a responsesignal to the preset signal is received from the display apparatus 20.

Based on the identification in the operation 602, it may be identifiedthat the display apparatus 20 is in the turned-on state or theturned-off state (603).

When it is identified in the operation 603 that the display apparatus 20is in the turned-off state, the processor 160 according to an embodimentmay output a sound for guiding a user to turn on the display apparatus20 through the speaker 110 (604). According to the disclosure, there areno limits to the guide sound to be output, and the guide sound may forexample include content for guiding a user to press a specific button ofthe electronic apparatus 10 so that a turning-on request can betransmitted to the display apparatus 20, or content for guiding a userto turn on the display apparatus 20.

Alternatively, the operation 604 of outputting the guide sound may beomitted in the electronic apparatus 10.

When it is identified in the operation 603 that the display apparatus 20is in the turned-off state, the processor 160 may control thecommunicator 140 to transmit a request signal for turning on the displayapparatus 20 to the display apparatus 20 (605).

According to an embodiment, when a user presses the specific button inresponse to the output of the guide sound for the press of thecorresponding button in the operation 604, the processor 160 may forexample transmit a request signal for turning on the display apparatus20 through the communicator 140.

According to another embodiment, when it is identified that the displayapparatus 20 is in the turned-off state, the processor 160 may directlytransmit the request signal for turning on the display apparatus 20through the communicator 140 without the output of the guide sound inthe operation 604 or a user's control.

The turning-on request signal in the operation 605 is received in thedisplay apparatus 20, so that the display apparatus 20 can be switchedover from the turned-off state to the turned-on state in response to thereception. The processor 260 of the display apparatus 20 may control thecommunicator 250 to transmit a signal for informing that the displayapparatus 20 is turned on to the electronic apparatus 10, and thereforea feedback signal to the turning-on request is transmitted to theelectronic apparatus 10.

When it is identified in the operation 603 that the display apparatus 20is in the turned-on state, the processor 160 may transmit informationabout the user voice received in the operation 601 to the displayapparatus 20 and makes a request for processing the voice to the displayapparatus 20 (606). The processor 160 may identify that the displayapparatus 20 is in the turned-on state, based on the response signalfrom the display apparatus 20. According to an embodiment, the responsesignal may correspond to the feedback signal to the foregoing turning-onrequest.

Here, the electronic apparatus 10 operates in the TV-on mode, so thatthe processor 160 can control the signal processor 130 to convert theuser voice, i.e. a soundwave received through the microphone 120 in theoperation 601 into an electric signal, and transmit data about theconverted signal as the information about the user voice to the displayapparatus 20 through the communicator 140.

The processor 260 of the display apparatus 20 may apply the voicerecognition to the user voice, and process the user voice to therebyperform an operation based on a result of the voice recognition. Here,when the information about the user voice is received from theelectronic apparatus 10, the processor 260 may execute or activate theAI speaker application installed in the display apparatus 20, in whichthe activation include switching over the running state of the AIspeaker application from the background mode to the foreground mode.

According to an embodiment, the voice recognition module 263 of theprocessor 260 extracts a vector of voice features from information aboutthe received user voice, and compares the extracted vector with theacoustic model of the database 251 or the server 30, thereby performingthe voice recognition.

The processor 260 of the display apparatus 20 processes the user voicebased on the voice recognition as described above, and display theprocess result on the display 230 as shown in FIG. 9. Further, theprocessor 260 may output a signal corresponding to the process result(i.e. the search result) to the electronic apparatus 10 through thecommunicator 140.

The processor 160 of the electronic apparatus 10 may receive the processresult of the operation 606 from the display apparatus 20, and output acorresponding sound through the speaker 110 (607). Thus, the result ofprocessing the user voice in the operation 606 may be not only displayedon the display apparatus 20 but also output as a sound corresponding tothe audio feedback, i.e. the response voice through the speaker 110.

According to the second embodiment of the disclosure, when the externalapparatus, i.e. the display apparatus 20 with which the electronicapparatus 10 can communicate is in the turned-off state, the electronicapparatus 10 controls the external apparatus, i.e. the display apparatus20 to be turned on to process the user voice. Therefore, as comparedwith the case where only the audio feedback is given through theelectronic apparatus 10, the visual feedback is further provided throughthe screen of the display apparatus 20, thereby improving a user'saccessibility to the process result, and increasing convenience asadditional information is more easily obtained as necessary.

FIG. 12 conceptually illustrates operation between an electronicapparatus and a display apparatus according to a third embodiment of thedisclosure, and FIG. 13 is a flowchart showing a method of controllingthe electronic apparatus according to the third embodiment of thedisclosure.

The electronic apparatus 10 according to the third embodiment of thedisclosure may, as shown in FIG. 12, identify a service type (or acontent type) related to a user voice, based on the user voice receivedthrough the microphone 120, and autonomously processes the user voice orrequests the display apparatus 20 to process the user voice based on theidentification result.

For example, when it is identified that the received user voice isrelated to services of providing acoustic content, i.e. audio/sound, forexample, music play, a weather report, current time, a timer, etc., theelectronic apparatus 10 may autonomously process the correspondingvoice.

In this case, the electronic apparatus 10 operates in the TV-off mode,thereby autonomously processing the user voice and outputting theprocess result through the speaker 110.

On the other hand, when it is identified that the received user voice isrelated to services of providing visual content, i.e. video/image, forexample a movie, a TV program, etc., the electronic apparatus 10 mayrequest the display apparatus 20 to process the corresponding voice.

In this case, the electronic apparatus 10 may transmits a request signalfor processing the voice to the display apparatus 20, and thus operatesin the TV-on mode (i.e. the TV link mode) as shown in FIG. 12. Theelectronic apparatus 10 operates in the TV-on mode, thereby transmittingthe information about the received user voice to the display apparatus20 through the communicator 140, and making a request for processing thevoice to the display apparatus 20. The display apparatus 20 processesthe user voice, and outputs a process result as an image through thedisplay 230.

Specifically, as shown in FIG. 13, the electronic apparatus 10 mayreceive a user voice uttered by a user through the microphone 120 (701).Here, the electronic apparatus 10 may receive various unrestricted uservoices through the microphone 120.

According to an embodiment, the processor 160 may detect a predeterminedkeyword uttered by a user (i.e. the wake-up keyword), therebyidentifying that the user voice is received through the microphone 120.

When it is identified that a predetermined keyword is input as the uservoice through the microphone 120, the processor 160 may execute oractivate the AI speaker application installed in the electronicapparatus 10, in which the activation includes switching the runningstate of the AI speaker application over from the background mode to theforeground mode.

Based on the user voice received in the operation 701, the processor 160identifies the service type of the received user voice (702). Forexample, the processor 160 identifies whether the user voice is relatedto the service of visual content such as a movie, a TV program, etc. oracoustic content such as music, weather, time, a timer, etc.

Based on the identification of the operation 702, the service type ofthe user voice is identified as the service of the visual content or theservice of the acoustic content (703).

When it is identified in the operation 703 that the service type of theuser voice is related to the visual content, the processor 160 mayidentify whether the display apparatus 20 is in the turned-off state orthe turned-on state (704). For example, the processor 160 transmits apreset signal to the display apparatus 20 through the communicator 140,and identify the power state of the display apparatus 20, in otherwords, whether the display apparatus 20 is in the turned-on orturned-off state, according to whether a response signal to the presetsignal is received from the display apparatus 20.

When it is identified in the operation 704 that the display apparatus 20is in the turned-off state, the processor 160 may output a sound forguiding a user to turn on the display apparatus 20 through the speaker110 (705). According to the disclosure, there are no limits to the guidesound to be output, and the guide sound may for example include contentfor guiding a user to press a specific button so that turning-on requestcan be transmitted to the display apparatus 20 of the electronicapparatus 10.

Alternatively, the operation 705 of outputting the guide sound may beomitted in the electronic apparatus 10.

When it is identified in the operation 704 that the display apparatus 20is in the turned-off state, the processor 160 may control thecommunicator 140 to transmit a request signal for turning on the displayapparatus 20 to the display apparatus 20 (706).

According to an embodiment, when a user presses the specific button inresponse to the output of the guide sound for the press of thecorresponding button in the operation 705, the processor 160 may forexample transmit a request signal for turning on the display apparatus20 through the communicator 140.

According to another embodiment, when it is identified that the displayapparatus 20 is in the turned-off state, the processor 160 may directlytransmit the request signal for turning on the display apparatus 20through the communicator 140 without the output of the guide sound inthe operation 705 or a user's control.

The turning-on request signal in the operation 706 is received in thedisplay apparatus 20, so that the display apparatus 20 can be switchedover from the turned-off state to the turned-on state in response to thereception. The processor 260 of the display apparatus 20 may control thecommunicator 250 to transmit a signal for informing that the displayapparatus 20 is turned on to the electronic apparatus 10, and thereforea feedback signal to the turning-on request is transmitted to theelectronic apparatus 10.

When it is identified in the operation 704 that the display apparatus 20is in the turned-on state, the processor 160 may transmit informationabout the user voice received in the operation 701 to the displayapparatus 20 and makes a request for processing the voice to the displayapparatus 20 (707). The processor 160 may identify that the displayapparatus 20 is in the turned-on state, based on the response signalfrom the display apparatus 20. According to an embodiment, the responsesignal may correspond to the feedback signal to the foregoing turning-onrequest.

Here, the processor 160 operates in the TV-on mode, and thus controlsthe signal processor 130 to convert the user voice, i.e. a soundwavereceived through the microphone 120 in the operation 701 into anelectric signal, and transmit data about the converted signal as theinformation about the user voice to the display apparatus 20 through thecommunicator 140.

The processor 260 of the display apparatus 20 may apply the voicerecognition to the user voice, and process the user voice to therebyperform an operation based on a result of the voice recognition. Here,when the information about the user voice is received from theelectronic apparatus 10, the processor 260 may execute or activate theAI speaker application installed in the display apparatus 20, in whichthe activation include switching over the running state of the AIspeaker application from the background mode to the foreground mode.

According to an embodiment, the voice recognition module 263 of theprocessor 260 extracts a vector of voice features from information aboutthe received user voice, and compares the extracted vector with theacoustic model of the database 251 or the server 30, thereby performingthe voice recognition.

The processor 260 of the display apparatus 20 processes the user voicebased on the voice recognition as described above, and display theprocess result, for example, on the display 230 as shown in FIG. 9.Further, the processor 260 may output a signal corresponding to theprocess result (i.e. the search result) to the electronic apparatus 10through the communicator 140.

The processor 160 of the electronic apparatus 10 may receive the processresult of the operation 707 from the display apparatus 20, and output acorresponding sound through the speaker 110 (708). Thus, the result ofprocessing the user voice in the operation 707 may be not only displayedon the display apparatus 20 but also output as a sound corresponding tothe audio feedback, i.e. the response voice through the speaker 110.

Meanwhile, when it is identified in the operation 703 that the servicetype of the user voice is related to the acoustic content, the processor160 may process the user voice received in the operation 701 (709).

Specifically, the electronic apparatus 10 operates in the TV-off mode,and thus the processor 160 applies the voice recognition to the uservoice, and performs a process related to the user voice so that anoperation based on the result of the voice recognition can be performed.

The processor 160 may control the signal processor 130 to convert theuser voice, i.e. the sound wave received through the microphone 120 intoan electric signal.

According to an embodiment, the voice recognition module 161 of theprocessor 160 extracts a vector of voice features from the signalconverted from the user voice, and compares the extracted vector withthe acoustic model of the server 30 or the database 151, therebyperforming the voice recognition.

The processor 160 performs operations to process the user voice based onthe foregoing voice recognition, and output the process result.

For example, when the user voice is related to a request for playing acertain genre, for example, classic music, the processor 160 may searchfor music of the corresponding genre through the communicator 140.

The processor 160 may output a sound corresponding to the process resultof the operation 709 through the speaker 110 (710). For example, whenthe user voice processed in the operation 709 is identified as a requestfor playing classic music, the speaker 110 may be controlled to output asound, i.e. play music based on the process result (i.e. the searchingresult).

According to the third embodiment of the disclosure as described above,the electronic apparatus 10 can process the user voice through thedisplay apparatus 20 when the service type of the user voice is relatedto the visual content. Therefore, it is more convenient for a userbecause the user can more efficiently receive a service, i.e. contentthrough the screen of the display apparatus 20.

FIG. 14 conceptually illustrates operation between an electronicapparatus and a display apparatus according to a fourth embodiment ofthe disclosure, and FIG. 15 is a flowchart showing a method ofcontrolling the electronic apparatus according to the fourth embodimentof the disclosure.

The display apparatus 20 according to the fourth embodiment of thedisclosure may, as shown in FIG. 14, identify a connection state betweenthe electronic apparatus 10 and the display apparatus 20, i.e. whetheror not the display apparatus 20 and the electronic apparatus 10 areconnected for the wired or wireless communication, based on change ofthe display apparatus 20 from the turned-off state to the turned-onstate, and receive a request for processing the user voice from theelectronic apparatus 10 when it is identified that the display apparatus20 and the electronic apparatus 10 are connected.

Here, when it is identified that the display apparatus 20 and theelectronic apparatus 10 are not connected, the display apparatus 20performs connection settings for the communication with the electronicapparatus 10, and then receive the request for processing the voice fromthe connected electronic apparatus 10.

The electronic apparatus 10 operates in the TV-on mode, therebytransmitting the information about the user voice to the displayapparatus 20, and making a request for processing the voice to thedisplay apparatus 20. The display apparatus 20 may, as shown in FIG. 14,process the user voice, and output a process result as an image throughthe display 230.

Specifically, as shown in FIG. 15, the display apparatus 20 may beswitched over from the turned-off state to the turned-on state (801).

Here, the turned-off state refers to a kind of soft turned-off state inwhich the display apparatus 20 operates in the standby mode of receivingthe standby power. As the first processor 261 of the turned-off state iswoken up by the second processor 262, the display apparatus 20 isswitched over to the turned-on state, in other words, the normal mode.

According to an embodiment, when the first processor 261 is in thepower-saving state, i.e. the turned-off state, the second processor 262may identify whether a user input is received through the user inputreceiver 270, and identify the change of the display apparatus 20 fromthe turned-off state to the turned-on state based on the received userinput according to identification results. Here, the received user inputmay for example be based on a user's control responding to the guidesound for turning on the display apparatus, which is output in theoperation 604 according to the embodiment of FIG. 11.

According to another embodiment, when the first processor 261 is in thepower-saving state, i.e. the turned-off state, the second processor 262may identify that a request signal for turning on the display apparatus20 is received from the electronic apparatus 10 through the communicator240, and identify that the display apparatus 20 is switched over fromthe turned-off state to the turned-on state based on the received signalaccording to the identification results. Here, the received requestsignal may for example be based on a signal transmitted in the operation605 according to the embodiment of FIG. 11.

When the display apparatus 20 is switched over to the turned-on state inthe operation 801, the first processor 261 is woken up and identifiesthe connection state of the external apparatus, i.e. the electronicapparatus 10 through the communicator 140 (802). For example, the firstprocessor 260 may transmit a preset signal to the electronic apparatus10 through the communicator 140, and identify whether the displayapparatus 20 and the electronic apparatus 10 are connected for the wiredor wireless communication based on whether the response signal to thepreset signal is received from the electronic apparatus 10.

Based on the identification in the operation 802, it is identifiedwhether the display apparatus 20 and the electronic apparatus 10 areconnected, in other words, whether they are in a connected state or adisconnected state (803).

When it is identified in the operation 803 that the display apparatus 20is not connected to the electronic apparatus 10, the processor 260, i.e.the first processor 261 may perform settings for connection with theelectronic apparatus 10 through the communicator 140 (804). Here, thereare no limits to the type of communication connection between thedisplay apparatus 20 and the electronic apparatus 10, and the type ofcommunication connection may for example include Bluetooth, Wi-Fi or thelike wireless communication connection.

When it is identified in the operation 803 that the display apparatus 20is connected to the electronic apparatus 10, the processor 260, i.e. thefirst processor 261 may receive information about the input user voicefrom the electronic apparatus 10 through the speaker 110 (805). Here,the received information about the user voice may include a request forprocessing the voice, and may correspond to the information about theuser voice transmitted from the electronic apparatus 10 to the displayapparatus 20 in the operation 606 according to the embodiment of FIG. 11or the operation 707 according to the embodiment of FIG. 13.

According to an embodiment, when the information about the user voice isreceived from the electronic apparatus 10, the processor 260 may executeor activate the AI speaker application installed in the displayapparatus 20, in which the activation include switching over the runningstate of the AI speaker application from the background mode to theforeground mode.

Based on the information about the user voice received in the operation804, the processor 260 may process the corresponding user voice (806).

Specifically, the processor 260 may apply the voice recognition to theuser voice, and process the user voice to perform an operation based ona result of the voice recognition.

According to an embodiment, the voice recognition module 263 of theprocessor 260 extracts a vector of voice features from information aboutthe received user voice, and compares the extracted vector with theacoustic model of the database 251 or the server 30, thereby performingthe voice recognition.

The processor 260 performs operations to process the user voice based onthe foregoing voice recognition, and output the process result.

For example, as shown in FIG. 8, when the user voice is related to arequest for searching for local restaurants, the processor 260 mayperform searching through the communicator 240.

The processor 260 controls the display 230 to display an imagecorresponding to the process result (i.e. a searching result) in theoperation 806 (807). For example, the processor 260 may, as shown inFIG. 8, control the display 230 to display a UI 501 showing the resultof searching the local restaurants.

The processor 260 may control the communicator 240 to output a signalcorresponding to the process result (i.e. the searching result) in theoperation 806 to the electronic apparatus 10 (808). Here, the outputsignal may correspond to the process result received in the electronicapparatus 10 in the operation 607 according to the embodiment of FIG. 11or the operation 708 according to the embodiment of FIG. 13.

The processor 160 of the electronic apparatus 10 may receive a signalcorresponding to the process result as described above, and output asound based on the received signal through the speaker 110. Therefore,the result of processing the user voice in the operation 807 may be notonly displayed on the display apparatus 20 but also output as an audiofeedback through the speaker 110.

According to the fourth embodiment of the disclosure as described above,when the display apparatus 20 is switched over from the turned-off stateto the turned-on state, the display apparatus 20 may automaticallyperform connection settings according to whether it is connected forcommunication with the external apparatus, i.e. the electronic apparatus10. Further, the display apparatus 20 receives the information about theuser voice from the connected electronic apparatus 10, so that the uservoice input to the electronic apparatus 10 can be processed in thedisplay apparatus 20. Therefore, with regard to a user input for which avisual feedback is efficient, a process result is provided as an imagethrough the screen of the display apparatus 20, thereby improving auser's accessibility to the process result, and more easily obtainingadditional information as necessary.

FIG. 16 conceptually illustrates operation between an electronicapparatus and a display apparatus according to a fifth embodiment of thedisclosure, FIG. 17 is a flowchart showing a method of controlling theelectronic apparatus according to the fifth embodiment of thedisclosure, FIG. 18 is a flowchart showing a method of controlling thedisplay apparatus according to the fifth embodiment of the disclosure,FIG. 19 illustrates a user interface (UI) displayed on the displayapparatus according to the fifth embodiment of the disclosure, and FIGS.20 and 21 illustrate UIs displayed on the display apparatus according tothe fifth embodiment of the disclosure.

According to the fifth embodiment of the disclosure, the electronicapparatus 10 monitors an operation for processing a voice receivedthrough the microphone 120.

The electronic apparatus 10 may be embodied to transmit a turning-onrequest to the external apparatus, i.e. the display apparatus 20 asshown in FIG. 16 based on occurrence of an error. In response to theturning-on request from the electronic apparatus 10, the displayapparatus 20 may be switched over from the turned-off state to theturned-on state.

Here, the electronic apparatus 10 may identify the power state of thedisplay apparatus 20, i.e. whether the display apparatus 20 is in theturned-on state or the turned-off state. When it is identified that thedisplay apparatus 20 is in the turned-off state, the electronicapparatus 10 may output a guide sound for turning on the displayapparatus 20 through the speaker 110. The guide sound may furtherinclude a message for informing that an error occurs in the electronicapparatus 10.

Further, when it is identified that the error occurs in the electronicapparatus 10, information about the error may be transmitted to thedisplay apparatus 20 as shown in FIG. 16. The display apparatus 20 mayperform an operation for correcting an error, based on the receivedinformation about the error from the electronic apparatus 10.

Specifically, as shown in FIG. 17, the electronic apparatus 10 mayperform monitoring an operation for applying a voice process to a uservoice received in the microphone 120 (901). Here, the monitoring is toidentify whether an error occurs in the voice process for operating theelectronic apparatus 10 as the AI speaker, and may for example includeidentifying whether an error occurs in user login, network connection,music or the like service settings, device settings, etc., in whichthere are no limits to the kinds of errors.

According to an embodiment, the monitoring in the operation 901 may beperformed in response to occurrence of a preset event such as an inputof a user, a signal input through the communicator 140, etc. or may beperiodically performed at predetermined time intervals.

Based on the monitoring in the operation 901, the processor 160 mayidentify that an error occurs in processing the voice (902). Here, theprocessor 160 may further identify the kinds of occurred error, forexample, an error in user login, an error in service settings, etc.

In the operation 901, when it is identified that the error occurs inprocessing the voice, the processor 160 may identify whether the displayapparatus 20 is in the turned-off state or the turned-on state throughthe communicator 140 (903). Here, the processor 160 may transmit apreset signal to the display apparatus 20 through the communicator 140,and identify the power state of the display apparatus 20, i.e. whetherthe display apparatus 20 is the turned-on state or the turned-off stateaccording to whether a response signal to the preset signal is receivedfrom the display apparatus 20.

According to an embodiment, the processor 160 may output a guide soundfor guiding a user to turn on the display apparatus 20 through thespeaker 110 based on the identification in the operation 903 that thedisplay apparatus 20 is in the turned-off state (904). According to thedisclosure, there are no limits to the guide sound to be output, and theguide sound may for example include content for guiding a user to pressa specific button of the electronic apparatus 10 so that a turning-onrequest can be transmitted to the display apparatus 20, or content forguiding a user to turn on the display apparatus 20.

According to another embodiment, the operation 904 of outputting theguide sound may be omitted in the electronic apparatus 10.

When it is identified in the operation 903 that the display apparatus 20is in the turned-off state, the processor 160 may control thecommunicator 140 to transmit a request signal for turning on the displayapparatus 20 to the display apparatus 20 (905).

According to an embodiment, when a user presses the specific button inresponse to the output of the guide sound for the press of thecorresponding button in the operation 904, the processor 160 may forexample transmit a request signal for turning on the display apparatus20 through the communicator 140.

According to another embodiment, when it is identified that the displayapparatus 20 is in the turned-off state, the processor 160 may directlytransmit the request signal for turning on the display apparatus 20through the communicator 140 without the output of the guide sound inthe operation 904 or a user's control. The guide sound for guiding auser to turn on the display apparatus 20 may be output through thespeaker 110 (904). According to the disclosure, there are no limits tothe guide sound to be output, and the guide sound may for exampleinclude content for guiding a user to press a specific button of theelectronic apparatus 10 so that a turning-on request can be transmittedto the display apparatus 20, or content for guiding a user to turn onthe display apparatus 20.

The turning-on request signal in the operation 905 is received in thedisplay apparatus 20, so that the display apparatus 20 can be switchedover from the turned-off state to the turned-on state in response to thereception. The processor 260 of the display apparatus 20 may control thecommunicator 250 to transmit a signal for informing that the displayapparatus 20 is turned on to the electronic apparatus 10, and thereforea feedback signal to the turning-on request is transmitted to theelectronic apparatus 10.

When it is identified in the operation 903 that the display apparatus 20is in the turned-on state, the processor 160 may control thecommunicator 140 to transmit information about an error identified inthe operation 902 to the display apparatus 20 (906).

According to an embodiment, the processor 160 may automatically transmitthe information about the error to the display apparatus 20 through thecommunicator 140 in response to the display apparatus 20 being turnedon.

According to another embodiment, when it is identified in the operation903 that the display apparatus 20 is in the turned-on state, theprocessor 160 may output a guide sound for correcting the error throughthe speaker 110 (904). According to the disclosure, there are no limitsto the guide sound to be output, and the guide sound may for exampleinclude content for guiding a user to press a specific button of theelectronic apparatus 10 to correct the error.

When a user presses the corresponding button in response to the guidesound, the processor 160 may transmit information about the identifiederror to the display apparatus through the communicator 140.

The display apparatus 20 receives the information about the error fromthe electronic apparatus 10, and perform an operation for correcting theerror in the electronic apparatus 10 based on the received information.Detailed operations for correcting the error, which are carried out inthe display apparatus 20 will be described in detail with reference toFIG. 18.

The processor 160 may receive a signal for informing whether the erroris corrected from the display apparatus 20 through the communicator 140(907).

Here, the display apparatus 20 performs the operation for correcting theerror based on the information transmitted in the operation 906, andfeeds the signal for informing whether the error is corrected or notback to the electronic apparatus 10 as a result of the operation, inwhich the corresponding signal is received in the electronic apparatus10 through the communicator 140.

Based on the signal received from the display apparatus 20 in theoperation 907, the processor 160 of the electronic apparatus 10 mayoutput a sound for informing the corrected error through the speaker 110(908). Therefore, a result from correcting the error may be not onlydisplayed on the display apparatus 20 but also output as a soundcorresponding to an audio feedback based on the process result throughthe speaker 110.

Meanwhile, as shown in FIG. 18, the display apparatus 20 may be switchedover from the turned-off state to the turned-on state (1001).

Here, the turned-off state refers to a kind of soft turned-off state inwhich the display apparatus 20 operates in the standby mode of receivingthe standby power. As the first processor 261 of the turned-off state iswoken up by the second processor 262, the display apparatus 20 isswitched over to the turned-on state, in other words, the normal mode.

In the operation 1001, the display apparatus 20 is turned on based on,for example, the turning-on request transmitted from the electronicapparatus 10 to the display apparatus 20 in the operation 905 of FIG.17.

The display apparatus 20 may receive information about the error inprocessing the voice from the electronic apparatus 10 through thecommunicator 240 (1002). The information about the error received in theoperation 1002 may correspond to the information transmitted from theelectronic apparatus 10 to the display apparatus 20 in the operation 906of FIG. 17.

The processor 260 of the display apparatus 20 may perform an operationfor correcting the error, based on the information received in theoperation 1001 (1003). Here, the processor 260 may automatically performthe operation for correcting the error, based on identification that thedisplay apparatus 20 is tuned on and the information about the error isreceived.

According to an embodiment, the processor 260 may correct an error inthe electronic apparatus 10, based on the setting information about thedisplay apparatus 20. For example, when a login error occurs due to auser account in the electronic apparatus 10, the processor 260 transmitsinformation about the user account of the display apparatus 20 to theelectronic apparatus 10, thereby allowing a user to log in to theelectronic apparatus 10 with the transmitted information about the useraccount. Like this, the setting information (or setting values) of boththe apparatuses 10 and 20 is paired, and it is thus easier toautomatically correct various errors that may occur in the electronicapparatus 10.

According to another embodiment, for example, when an error occurs inlogging in to the electronic apparatus 10 with a user account, theprocessor 260 may control the display 230 to display a screen includingmenu items for setting a user account. When a user sets the user accountalong a guide on the displayed screen, data of the setting result istransmitted to the electronic apparatus 10, thereby correcting the errorin user login.

According to still another embodiment, the processor 260 may control thedisplay 230 to display a UI about occurrence of an error, and performsan operation for correcting the error based on a user's selection on thedisplayed UI.

For example, as shown in FIG. 19, the processor 260 informs a user thatan error occurs in the electronic apparatus 10, i.e. the AI speaker, andcontrols the display 230 to display at least one UI 1101, 1102 or 1103for allowing the user to select whether to correct an error. When theuser selects the item 1102 of “YES” among the displayed UIs, theprocessor 260 performs the corresponding operation for correcting theerror.

Alternatively, the processor 260 may, as shown in FIG. 20, inform a userthat an error occurs in the electronic apparatus 10, i.e. the AIspeaker, and controls the display 230 to display a UI 1104 including amessage for guiding a user's control for the correction.

According to the disclosure, the displayed UI about the occurrence ofthe error is not limited to that shown in the drawings. When a usermakes selection for the correction of the error in response to the UIshown in FIG. 19 or 20, the error may be corrected automatically orbased on user settings in the same manner as those of the foregoingembodiments.

When the operation for correcting the error is performed in theoperation 1003, the processor 260 may control the display 230 to displaya UI for informing a user that the error will be corrected (1004).

For example, as shown in FIG. 21, the processor 260 may control thedisplay 230 to display a UI 1105 for informing a user that the error inthe electronic apparatus 10, i.e. the AI speaker is corrected and theelectronic apparatus 10 is back in working order.

When the operation for correcting the error is performed in theoperation 1003, the processor 260 may control the communicator 240 tooutput a signal for informing the error correction to the electronicapparatus 10 (1005).

The processor 160 of the electronic apparatus 10 may receive the signalfrom the display apparatus 20, and output a sound based on the signal,i.e. a sound for informing the error correction through the speaker 110.Therefore, the error correction in the operation 1003 is not onlydisplayed on the display apparatus 20 but also output as an audiofeedback through the speaker 110.

According to the fifth embodiment of the disclosure, when an erroroccurs in processing a voice in the electronic apparatus 10, informationabout the error is transmitted to the display apparatus 20, and thus theerror is corrected using the display apparatus 20. Therefore, a visualfeedback on the correction of the error is provided through the screenof the display apparatus 20, and the automatic error correction is moreconvenient for a user.

FIG. 22 conceptually illustrates operation between an electronicapparatus and a display apparatus according to a sixth embodiment of thedisclosure, and FIG. 23 is a flowchart showing a method of controllingthe electronic apparatus according to the sixth embodiment of thedisclosure.

The electronic apparatus 10 according to the sixth embodiment of thedisclosure may further include an infrared (IR) emitter capable ofoutputting an IR signal having a predetermined frequency band ascompared with the electronic apparatus according to the embodiment shownin FIG. 3, and the display apparatus 20 according to the sixthembodiment may further include an IR receiver capable of receiving theIR signal as compared with the embodiment shown in FIG. 4. In otherwords, the electronic apparatus 10 can emit an IR signal, and thedisplay apparatus 20 can receive the IR signal.

According to the sixth embodiment, the electronic apparatus 10 may, asshown in FIG. 22, transmit an IR signal for a connection request fromthe electronic apparatus 10 to the display apparatus 20, so that boththe apparatuses 10 and 20 can be connected based on the IR signal. Here,the electronic apparatus 10 and the display apparatus 20 may beconnected to each other based on Wi-Fi, Bluetooth and the like wirelesscommunication.

According to the sixth embodiment, the electronic apparatus 10 forexample emits the IR signal when turned on by power supplied for thefirst time. In other words, when the electronic apparatus 10 is suppliedwith power as installed for the first time, the electronic apparatus 10and the display apparatus 20 may be automatically paired based on the IRsignal.

The electronic apparatus 10 and the display apparatus 20 connected bythe wireless communication exchange, i.e. transmit and receive accountinformation including user information with each other, so that theaccount information between both the apparatuses 10 and 20 can besynchronized with each other in real time as shown in FIG. 22.

Specifically, as shown in FIG. 23, the electronic apparatus 10 may beturned on, in other words, switched over from the turned-off state tothe turned-on state (1201). Here, the electronic apparatus 10 may beturned on by power supplied for the first time.

When the electronic apparatus 10 is turned on in the operation 1201, theprocessor 160 outputs the IR signal for requesting the connection(1202).

The IR signal output in the operation 1202 may be received in thedisplay apparatus 20. Here, the IR signal is a short-range wirelesssignal having directivity, and is therefore unlikely received in otherapparatuses than the display apparatus 20, for example, a television orthe like of a neighboring house.

The IR signal output in the operation 1202 may include identificationinformation for connection with the display apparatus 20. Theidentification information may for example include a Bluetooth deviceaddress, a MAC address, etc. and the IR signal may include theidentification information corresponding to the first communicator 140.

Based on the IR signal transmitted in the operation 1202, the electronicapparatus 10 and the display apparatus 20 may be connected (1203).

According to an embodiment, the processor 260 of the display apparatus20 receiving the IR signal may establish communication by tryingconnecting with the electronic apparatus based on the identificationinformation included in the received IR signal. As the communication issuccessfully established, the electronic apparatus 10 and the displayapparatus 20 are connected to communicate with each other.

The electronic apparatus 10 and the display apparatus 20 connected toeach other in the operation 1203 may synchronize with each other withrespect to synchronize with account information (1204). Here, theaccount information may include user information for login, for example,identification (ID) and a password, etc., and the electronic apparatus10 and the display apparatus 20 may exchange, i.e. transmit and receivethe account information including the user information with each other,so that both the apparatuses 10 and 20 can synchronize with each otherwith respect to the account information.

Therefore, the electronic apparatus 10 and the display apparatus 20 maybe logged in with the same account, and service histories used with thecorresponding account, for example, searching histories based on uservoices, a list of frequently played music, etc. may be collectivelymanaged by the external server 30.

Further, when there is a change in the account information, theelectronic apparatus 10 and the display apparatus 20 may synchronizewith each other reflecting the change in real time. Here, the changedaccount information may be transmitted to the server 30 in real time, sothat the changes can be applied to not only the electronic apparatus 10and the display apparatus 20 but also other devices such as asmartphone, etc. usable with the corresponding account.

According to the sixth embodiment of the disclosure, the electronicapparatus 10 outputs the IR signal when supplied with power toautomatically connect with the display apparatus 20, and is thereforeinconvenient for a user who is not used to using electronic devicesbecause the user does not need to separately do communication settings.Further, the electronic apparatus 10 and the display apparatus 20 whichare connected synchronize with each other with respect to the accountinformation, so that a user can get services reflecting the up-to-datedata under the same environments in all apparatuses.

As described above, according to an electronic apparatus, a displayapparatus, and a method of controlling the same, the electronicapparatus capable of receiving and processing a user voice autonomouslyprocesses the user voice or allows the display apparatus to selectivelyprocess the user voice, and provides process results in accordance withon/off states of the display apparatus, thereby extending functions andservices.

Further, according to an electronic apparatus, a display apparatus, anda method of controlling the same, the electronic apparatus autonomouslyprocesses a received user voice or allows the display apparatus toselectively process the user voice, and provides process results inaccordance with service/content types provided by voice processes,thereby receiving more efficiently the service/content through a screenwhen visual feedback is needed.

Further, according to an electronic apparatus, a display apparatus, anda method of controlling the same, the electronic apparatus providesinformation about an error in processing a user voice to the displayapparatus, so that the error can be corrected through the displayapparatus.

Although a few exemplary embodiments have been shown and described, itwill be appreciated that changes may be made in these exemplaryembodiments without departing from the scope defined in the appendedclaims.

1. An electronic apparatus comprising: a communicator; a voice receiver;a speaker configured to provide a sound; a processor configured to:receive a user voice input through the voice receiver, based on anexternal apparatus being in a standby state, perform a functioncorresponding to the user voice input and control the speaker to providea result of the function corresponding to the user voice input, andbased on the external apparatus being in a normal state, control thecommunicator to transmit a data corresponding to the user voice input tothe external apparatus for performing a function of the externalapparatus corresponding to the user voice input.
 2. The electronicapparatus according to claim 1, wherein the standby state corresponds toa turned-off state of the external apparatus.
 3. The electronicapparatus according to claim 1, wherein the processor is configured totransmit a signal to operate the external apparatus in the normal stateto the external apparatus through the communicator based on the uservoice input being received while the external apparatus is in thestandby state.
 4. The electronic apparatus according to claim 3, whereinthe processor is configured not to provide the result of the functioncorresponding to the user voice input through the speaker based on thesignal to operate the external apparatus in the normal state beingtransmitted to the external apparatus.
 5. The electronic apparatusaccording to claim 3, wherein the external apparatus performs thefunction of the external apparatus corresponding to the user voice inputand provides a result of the function of the external apparatuscorresponding to the user voice input through a display of the externalapparatus according to the signal to operate the external apparatus inthe normal state.
 6. The electronic apparatus according to claim 1,wherein the processor is configured to provide a guide to operate theexternal apparatus in the normal state based on the user voice inputbeing received while the external apparatus is in the standby state. 7.The electronic apparatus according to claim 1, wherein the processor isconfigured to: transmit a preset signal to the external apparatusthrough the communicator based on the user voice input being receivedthrough the voice receiver, identify a state of the external apparatusbased on whether a response signal to the preset signal is received fromthe external apparatus.
 8. The electronic apparatus according to claim1, wherein the processor is configured to: identify a content typerelated to the user voice input, and identify whether to transmit thedata corresponding the user voice input to request the externalapparatus to perform the function of the external apparatuscorresponding to the user voice input based on the identified contenttype.
 9. The electronic apparatus according to claim 5, wherein theprocessor is configured to: receive a signal related to the result ofthe function of the external apparatus corresponding to the user voiceinput from the external apparatus through the communicator, control thespeaker to provide a sound related to the result of the function of theexternal apparatus corresponding to the user voice input.
 10. Theelectronic apparatus according to claim 1, wherein the processor isconfigured to: identify a connection state between the electronicapparatus and the external apparatus based on change of the externalapparatus from the standby state to the normal state, perform connectionsettings for communication between the electronic apparatus and theexternal apparatus based on the connection state.
 11. A method ofcontrolling an electronic apparatus, comprising: receiving a user voiceinput through a voice receiver, based on an external apparatus being ina standby state, performing a function corresponding to the user voiceinput and providing a result of the function corresponding to the uservoice input through a speaker, and based on the external apparatus beingin a normal state, transmitting a data corresponding to the user voiceinput to the external apparatus for performing a function of theexternal apparatus corresponding to the user voice input though acommunicator.
 12. The method according to claim 11, wherein the standbystate corresponds to a turned-off state of the external apparatus. 13.The method according to claim 11, further comprising transmitting asignal to operate the external apparatus in the normal state to theexternal apparatus through the communicator based on the user voiceinput being received while the external apparatus is in the standbystate.
 14. The method according to claim 13, further comprising: not toproviding the result of the function corresponding to the user voiceinput through the speaker based on the signal to operate the externalapparatus in the normal state being transmitted to the externalapparatus.
 15. The method according to claim 13, wherein the externalapparatus performs the function of the external apparatus correspondingto the user voice input and provides a result of the function of theexternal apparatus corresponding to the user voice input through adisplay of the external apparatus according to the signal to operate theexternal apparatus in the normal state.
 16. The method according toclaim 11, further comprising: providing a guide to operate the externalapparatus in the normal state based on the user voice input beingreceived while the external apparatus is in the standby state.
 17. Themethod according to claim 11, further comprising: transmitting a presetsignal to the external apparatus through the communicator based on theuser voice input being received through the voice receiver, identifyinga state of the external apparatus based on whether a response signal tothe preset signal is received from the external apparatus.
 18. Themethod according to claim 11, further comprising: identifying a contenttype related to the user voice input, and identifying whether totransmit the data corresponding the user voice input to request theexternal apparatus to perform the function of the external apparatuscorresponding to the user voice input based on the identified contenttype.
 19. The method according to claim 15, further comprising:receiving a signal related to the result of the function of the externalapparatus corresponding to the user voice input from the externalapparatus through the communicator, providing a sound related to theresult of the function of the external apparatus corresponding to theuser voice input through the speaker.
 20. The method according to claim11, further comprising: identifying a connection state between theelectronic apparatus and the external apparatus based on change of theexternal apparatus from the standby state to the normal state,performing connection settings for communication between the electronicapparatus and the external apparatus based on the connection state.